Physiological responses during performance within a virtual scenario for the rehabilitation of motor deficits

Real-time physiological feedback can be used to modulate a virtual reality (VR) experience. It is not obvious, however, which parameters are most effective in achieving this such as heart rate variability and or the electrodermal response. Here we address this question by assessing the impact of the events generated by a VR based rehabilitation system on the affective state of human users. We show how the Rehabilitation Gaming System (RGS), a tool developed for the rehabilitation of motor deficits following stroke, can be enhanced using the online monitoring of bodily changes that are not under direct voluntary control. We show specific effects of the RGS on the autonomic nervous system and we propose how to use these for the modulation of the emotional state of the subject and performance.info:eu-repo/semantics/publishedVersio

High Classification Accuracy of a Motor Imagery Based Brain-Computer Interface for Stroke Rehabilitation Training

Motor imagery (MI) based brain-computer interfaces (BCI) extract commands in real-time and can be used to control a cursor, a robot or functional electrical stimulation (FES) devices. The control of FES devices is especially interesting for stroke rehabilitation, when a patient can use motor imagery to stimulate specific muscles in real-time. However, damage to motor areas resulting from stroke or other causes might impair control of a motor imagery BCI for rehabilitation. The current work presents a comparative evaluation of the MI-based BCI control accuracy between stroke patients and healthy subjects. Five patients who had a stroke that affected the motor system participated in the current study, and were trained across 10–24 sessions lasting about 1 h each with the recoveriX system. The participants' EEG data were classified while they imagined left or right hand movements, and real-time feedback was provided on a monitor. If the correct imagination was detected, the FES was also activated to move the left or right hand. The grand average mean accuracy was 87.4% for all patients and sessions. All patients were able to achieve at least one session with a maximum accuracy above 96%. Both the mean accuracy and the maximum accuracy were surprisingly high and above results seen with healthy controls in prior studies. Importantly, the study showed that stroke patients can control a MI BCI system with high accuracy relative to healthy persons. This may occur because these patients are highly motivated to participate in a study to improve their motor functions. Participants often reported early in the training of motor improvements and this caused additional motivation. However, it also reflects the efficacy of combining motor imagination, seeing continuous bar feedback, and real hand movement that also activates the tactile and proprioceptive systems. Results also suggested that motor function could improve even if classification accuracy did not, and suggest other new questions to explore in future work. Future studies will also be done with a first-person view 3D avatar to provide improved feedback and thereby increase each patients' sense of engagement

Hypothesis-driven genome-wide association studies provide novel insights into genetics of reading disabilities

Reading Disability (RD) is often characterized by difficulties in the phonology of the language. While the molecular mechanisms underlying it are largely undetermined, loci are being revealed by genome-wide association studies (GWAS). In a previous GWAS for word reading (Price, 2020), we observed that top single-nucleotide polymorphisms (SNPs) were located near to or in genes involved in neuronal migration/axon guidance (NM/AG) or loci implicated in autism spectrum disorder (ASD). A prominent theory of RD etiology posits that it involves disturbed neuronal migration, while potential links between RD-ASD have not been extensively investigated. To improve power to identify associated loci, we up-weighted variants involved in NM/AG or ASD, separately, and performed a new Hypothesis-Driven (HD)–GWAS. The approach was applied to a Toronto RD sample and a meta-analysis of the GenLang Consortium. For the Toronto sample (n = 624), no SNPs reached significance; however, by gene-set analysis, the joint contribution of ASD-related genes passed the threshold (p~1.45 × 10–2, threshold = 2.5 × 10–2). For the GenLang Cohort (n = 26,558), SNPs in DOCK7 and CDH4 showed significant association for the NM/AG hypothesis (sFDR q = 1.02 × 10–2). To make the GenLang dataset more similar to Toronto, we repeated the analysis restricting to samples selected for reading/language deficits (n = 4152). In this GenLang selected subset, we found significant association for a locus intergenic between BTG3-C21orf91 for both hypotheses (sFDR q < 9.00 × 10–4). This study contributes candidate loci to the genetics of word reading. Data also suggest that, although different variants may be involved, alleles implicated in ASD risk may be found in the same genes as those implicated in word reading. This finding is limited to the Toronto sample suggesting that ascertainment influences genetic associations

Predicting mental imagery based BCI performance from personality, cognitive profile and neurophysiological patterns

Mental-Imagery based Brain-Computer Interfaces (MI-BCIs) allow their users to send commands to a computer using their brain-activity alone (typically measured by ElectroEncephaloGraphy— EEG), which is processed while they perform specific mental tasks. While very promising, MI-BCIs remain barely used outside laboratories because of the difficulty encountered by users to control them. Indeed, although some users obtain good control performances after training, a substantial proportion remains unable to reliably control an MI-BCI. This huge variability in user-performance led the community to look for predictors of MI-BCI control ability. However, these predictors were only explored for motor-imagery based BCIs, and mostly for a single training session per subject. In this study, 18 participants were instructed to learn to control an EEG-based MI-BCI by performing 3 MI-tasks, 2 of which were non-motor tasks, across 6 training sessions, on 6 different days. Relationships between the participants’ BCI control performances and their personality, cognitive profile and neurophysiological markers were explored. While no relevant relationships with neurophysiological markers were found, strong correlations between MI-BCI performances and mental-rotation scores (reflecting spatial abilities) were revealed. Also, a predictive model of MI-BCI performance based on psychometric questionnaire scores was proposed. A leave-one-subject-out cross validation process revealed the stability and reliability of this model: it enabled to predict participants’ performance with a mean error of less than 3 points. This study determined how users’ profiles impact their MI-BCI control ability and thus clears the way for designing novel MI-BCI training protocols, adapted to the profile of each user

Invariance and variability in interaction error-related potentials and their consequences for classification

© 2017 IOP Publishing Ltd. Objective. This paper discusses the invariance and variability in interaction error-related potentials (ErrPs), where a special focus is laid upon the factors of (1) the human mental processing required to assess interface actions (2) time (3) subjects. Approach. Three different experiments were designed as to vary primarily with respect to the mental processes that are necessary to assess whether an interface error has occurred or not. The three experiments were carried out with 11 subjects in a repeated-measures experimental design. To study the effect of time, a subset of the recruited subjects additionally performed the same experiments on different days. Main results. The ErrP variability across the different experiments for the same subjects was found largely attributable to the different mental processing required to assess interface actions. Nonetheless, we found that interaction ErrPs are empirically invariant over time (for the same subject and same interface) and to a lesser extent across subjects (for the same interface). Significance. The obtained results may be used to explain across-study variability of ErrPs, as well as to define guidelines for approaches to the ErrP classifier transferability problem

A multifunctional brain-computer interface intended for home use: An evaluation with healthy participants and potential end users with dry and gel-based electrodes

Current brain-computer interface (BCIs) software is often tailored to the needs of scientists and technicians and therefore complex to allow for versatile use. To facilitate home use of BCIs a multifunctional P300 BCI with a graphical user interface intended for non-expert set-up and control was designed and implemented. The system includes applications for spelling, web access, entertainment, artistic expression and environmental control. In addition to new software, it also includes new hardware for the recording of electroencephalogram (EEG) signals. The EEG system consists of a small and wireless amplifier attached to a cap that can be equipped with gel-based or dry contact electrodes. The system was systematically evaluated with a healthy sample, and targeted end users of BCI technology, i.e., people with a varying degree of motor impairment tested the BCI in a series of individual case studies. Usability was assessed in terms of effectiveness, efficiency and satisfaction. Feedback of users was gathered with structured questionnaires. Two groups of healthy participants completed an experimental protocol with the gel-based and the dry contact electrodes (N = 10 each). The results demonstrated that all healthy participants gained control over the system and achieved satisfactory to high accuracies with both gel-based and dry electrodes (average error rates of 6 and 13%). Average satisfaction ratings were high, but certain aspects of the system such as the wearing comfort of the dry electrodes and design of the cap, and speed (in both groups) were criticized by some participants. Six potential end users tested the system during supervised sessions. The achieved accuracies varied greatly from no control to high control with accuracies comparable to that of healthy volunteers. Satisfaction ratings of the two end-users that gained control of the system were lower as compared to healthy participants. The advantages and disadvantages of the BCI and its applications are discussed and suggestions are presented for improvements to pave the way for user friendly BCIs intended to be used as assistive technology by persons with severe paralysis

Exploration of neural correlates of movement intention based on characterisation of temporal dependencies in electroencephalography

Brain computer interfaces (BCIs) provide a direct communication channel by using brain signals, enabling patients with motor impairments to interact with external devices. Motion intention detection is useful for intuitive movement-based BCI as movement is the fundamental mode of interaction with the environment. The aim of this paper is to investigate the temporal dynamics of brain processes using electroencephalography (EEG) to explore novel neural correlates of motion intention. We investigate the changes in temporal dependencies of the EEG by characterising the decay of autocorrelation during asynchronous voluntary finger tapping movement. The evolution of the autocorrelation function is characterised by its relaxation time, which is used as a robust marker for motion intention. We observed that there was reorganisation of temporal dependencies in EEG during motion intention. The autocorrelation decayed slower during movement intention and faster during the resting state. There was an increase in temporal dependence during movement intention. The relaxation time of the autocorrelation function showed significant (p < 0.05) discrimination between movement and resting state with the mean sensitivity of 78.37 ± 8.83%. The relaxation time provides movement related information that is complementary to the well-known event-related desynchronisation (ERD) by characterising the broad band EEG dynamics which is frequency independent in contrast to ERD. It can also detect motion intention on average 0.51s before the actual movement onset. We have thoroughly compared autocorrelation relaxation time features with ERD in four frequency bands. The relaxation time may therefore, complement the well-known features used in motion-based BCI leading to more robust and intuitive BCI solutions. The results obtained suggest that changes in autocorrelation decay may involve reorganisation of temporal dependencies of brain activity over longer duration during motion intention. This opens the possibilities of investigating further the temporal dynamics of fundamental neural processes underpinning motion intention

A Virtual Reprise of the Stanley Milgram Obedience Experiments

BACKGROUND: Stanley Milgram's 1960s experimental findings that people would administer apparently lethal electric shocks to a stranger at the behest of an authority figure remain critical for understanding obedience. Yet, due to the ethical controversy that his experiments ignited, it is nowadays impossible to carry out direct experimental studies in this area. In the study reported in this paper, we have used a similar paradigm to the one used by Milgram within an immersive virtual environment. Our objective has not been the study of obedience in itself, but of the extent to which participants would respond to such an extreme social situation as if it were real in spite of their knowledge that no real events were taking place. METHODOLOGY: Following the style of the original experiments, the participants were invited to administer a series of word association memory tests to the (female) virtual human representing the stranger. When she gave an incorrect answer, the participants were instructed to administer an ‘electric shock’ to her, increasing the voltage each time. She responded with increasing discomfort and protests, eventually demanding termination of the experiment. Of the 34 participants, 23 saw and heard the virtual human, and 11 communicated with her only through a text interface. CONCLUSIONS: Our results show that in spite of the fact that all participants knew for sure that neither the stranger nor the shocks were real, the participants who saw and heard her tended to respond to the situation at the subjective, behavioural and physiological levels as if it were real. This result reopens the door to direct empirical studies of obedience and related extreme social situations, an area of research that is otherwise not open to experimental study for ethical reasons, through the employment of virtual environments

Applying a brain-computer interface to support motor imagery practice in people with stroke for upper limb recovery: A feasibility study

<p>Abstract</p> <p>Background</p> <p>There is now sufficient evidence that using a rehabilitation protocol involving motor imagery (MI) practice in conjunction with physical practice (PP) of goal-directed rehabilitation tasks leads to enhanced functional recovery of paralyzed limbs among stroke sufferers. It is however difficult to confirm patient engagement during an MI in the absence of any on-line measure. Fortunately an EEG-based brain-computer interface (BCI) can provide an on-line measure of MI activity as a neurofeedback for the BCI user to help him/her focus better on the MI task. However initial performance of novice BCI users may be quite moderate and may cause frustration. This paper reports a pilot study in which a BCI system is used to provide a computer game-based neurofeedback to stroke participants during the MI part of a protocol.</p> <p>Methods</p> <p>The participants included five chronic hemiplegic stroke sufferers. Participants received up to twelve 30-minute MI practice sessions (in conjunction with PP sessions of the same duration) on 2 days a week for 6 weeks. The BCI neurofeedback performance was evaluated based on the MI task classification accuracy (CA) rate. A set of outcome measures including action research arm test (ARAT) and grip strength (GS), was made use of in assessing the upper limb functional recovery. In addition, since stroke sufferers often experience physical tiredness, which may influence the protocol effectiveness, their fatigue and mood levels were assessed regularly.</p> <p>Results</p> <p>Positive improvement in at least one of the outcome measures was observed in all the participants, while improvements approached a minimal clinically important difference (MCID) for the ARAT. The on-line CA of MI induced sensorimotor rhythm (SMR) modulation patterns in the form of lateralized event-related desynchronization (ERD) and event-related synchronization (ERS) effects, for novice participants was in a moderate range of 60-75% within the limited 12 training sessions. The ERD/ERS change from the first to the last session was statistically significant for only two participants.</p> <p>Conclusions</p> <p>Overall the crucial observation is that the moderate BCI classification performance did not impede the positive rehabilitation trends as quantified with the rehabilitation outcome measures adopted in this study. Therefore it can be concluded that the BCI supported MI is a feasible intervention as part of a post-stroke rehabilitation protocol combining both PP and MI practice of rehabilitation tasks. Although these findings are promising, the scope of the final conclusions is limited by the small sample size and the lack of a control group.</p

Full-bandwidth electrophysiology of seizures and epileptiform activity enabled by flexible graphene microtransistor depth neural probes

Mapping the entire frequency bandwidth of brain electrophysiological signals is of paramount importance for understanding physiological and pathological states. The ability to record simultaneously DC-shifts, infraslow oscillations (<0.1 Hz), typical local field potentials (0.1-80 Hz) and higher frequencies (80-600 Hz) using the same recording site would particularly benefit preclinical epilepsy research and could provide clinical biomarkers for improved seizure onset zone delineation. However, commonly used metal microelectrode technology suffers from instabilities that hamper the high fidelity of DC-coupled recordings, which are needed to access signals of very low frequency. In this study we used flexible graphene depth neural probes (gDNPs), consisting of a linear array of graphene microtransistors, to concurrently record DC-shifts and high-frequency neuronal activity in awake rodents. We show here that gDNPs can reliably record and map with high spatial resolution seizures, pre-ictal DC-shifts and seizure-associated spreading depolarizations together with higher frequencies through the cortical laminae to the hippocampus in a mouse model of chemically induced seizures. Moreover, we demonstrate the functionality of chronically implanted devices over 10 weeks by recording with high fidelity spontaneous spike-wave discharges and associated infraslow oscillations in a rat model of absence epilepsy. Altogether, our work highlights the suitability of this technology for in vivo electrophysiology research, and in particular epilepsy research, by allowing stable and chronic DC-coupled recordings